video manipulation
Video Manipulations Beyond Faces: A Dataset with Human-Machine Analysis
Mittal, Trisha, Sinha, Ritwik, Swaminathan, Viswanathan, Collomosse, John, Manocha, Dinesh
As tools for content editing mature, and artificial intelligence (AI) based algorithms for synthesizing media grow, the presence of manipulated content across online media is increasing. This phenomenon causes the spread of misinformation, creating a greater need to distinguish between ``real'' and ``manipulated'' content. To this end, we present VideoSham, a dataset consisting of 826 videos (413 real and 413 manipulated). Many of the existing deepfake datasets focus exclusively on two types of facial manipulations -- swapping with a different subject's face or altering the existing face. VideoSham, on the other hand, contains more diverse, context-rich, and human-centric, high-resolution videos manipulated using a combination of 6 different spatial and temporal attacks. Our analysis shows that state-of-the-art manipulation detection algorithms only work for a few specific attacks and do not scale well on VideoSham. We performed a user study on Amazon Mechanical Turk with 1200 participants to understand if they can differentiate between the real and manipulated videos in VideoSham. Finally, we dig deeper into the strengths and weaknesses of performances by humans and SOTA-algorithms to identify gaps that need to be filled with better AI algorithms. We present the dataset at https://github.com/adobe-research/VideoSham-dataset.
Video manipulation: 'I never said that' - BBC News
This facial mapping technology has been designed to improve television language dubbing, but it also has strong potential for those seeking to deceive. BBC's Media Editor Amol Rajan looks at the benefits and risks - and tries it out himself. This story is part of a series by the BBC on disinformation and fake news - a global problem challenging the way we share information and perceive the world around us. To see more stories and learn more about the series visit www.bbc.co.uk/beyondfakenews
Wait, is that video real? The race against deepfakes and dangers of manipulated recordings
Deepfakes are video manipulations that can make people say seemingly strange things. Barack Obama and Nicolas Cage have been featured in these videos. It used to take a lot of time and expertise to realistically falsify videos. For decades, authentic-looking video renderings were only seen in big-budget sci-fi movies films like "Star Wars." However, thanks to the rise in artificial intelligence, doctoring footage has become more accessible than ever, which researchers say poses a threat to national security.
The New AI Tech Turning Heads in Video Manipulation
A new technique using artificial intelligence to manipulate video content gives new meaning to the expression "talking head." An international team of researchers showcased the latest advancement in synthesizing facial expressions--including mouth, eyes, eyebrows, and even head position--in video at this month's 2018 SIGGRAPH, a conference on innovations in computer graphics, animation, virtual reality, and other forms of digital wizardry. The project is called Deep Video Portraits. It relies on a type of AI called generative adversarial networks (GANs) to modify a "target" actor based on the facial and head movement of a "source" actor. As the name implies, GANs pit two opposing neural networks against one another to create a realistic talking head, right down to the sneer or raised eyebrow.